Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] Fix broken workflows #2418

Merged
merged 1 commit into from
Sep 4, 2024
Merged

[CI] Fix broken workflows #2418

merged 1 commit into from
Sep 4, 2024

Conversation

vmoens
Copy link
Contributor

@vmoens vmoens commented Sep 4, 2024 •
edited
Loading

No description provided.

@vmoens
[CI] Fix broken workflows
669d352 
ghstack-source-id: 56beaf2935b18aab56f9c1773c7a7e104de3f74c
Pull Request resolved: #2414
@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Sep 4, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2418

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (22 Unrelated Failures)

As of commit 669d352 with merge base 5a81930 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Sep 4, 2024
@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Sep 4, 2024
@vmoens vmoens merged commit 0326c41 into main Sep 4, 2024
18 of 30 checks passed
@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 4, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 91. Improved: $\large\color{#35bf28}4$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 59.8216ms 58.3017ms 17.1521 Ops/s 16.9965 Ops/s $\color{#35bf28}+0.92\%$
test_sync 38.9184ms 33.0750ms 30.2343 Ops/s 28.8155 Ops/s $\color{#35bf28}+4.92\%$
test_async 60.1972ms 32.2644ms 30.9939 Ops/s 31.0757 Ops/s $\color{#d91a1a}-0.26\%$
test_simple 0.5152s 0.4246s 2.3553 Ops/s 2.4554 Ops/s $\color{#d91a1a}-4.08\%$
test_transformed 0.6504s 0.5753s 1.7381 Ops/s 1.7617 Ops/s $\color{#d91a1a}-1.34\%$
test_serial 1.3598s 1.2731s 0.7855 Ops/s 0.7754 Ops/s $\color{#35bf28}+1.30\%$
test_parallel 1.1996s 1.1242s 0.8895 Ops/s 0.8851 Ops/s $\color{#35bf28}+0.49\%$
test_step_mdp_speed[True-True-True-True-True] 0.1876ms 27.7956μs 35.9769 KOps/s 36.9493 KOps/s $\color{#d91a1a}-2.63\%$
test_step_mdp_speed[True-True-True-True-False] 70.4020μs 16.3669μs 61.0990 KOps/s 63.0604 KOps/s $\color{#d91a1a}-3.11\%$
test_step_mdp_speed[True-True-True-False-True] 56.0650μs 16.0798μs 62.1899 KOps/s 64.6308 KOps/s $\color{#d91a1a}-3.78\%$
test_step_mdp_speed[True-True-True-False-False] 27.8420μs 9.4542μs 105.7730 KOps/s 108.5140 KOps/s $\color{#d91a1a}-2.53\%$
test_step_mdp_speed[True-True-False-True-True] 64.3810μs 29.6619μs 33.7132 KOps/s 34.8555 KOps/s $\color{#d91a1a}-3.28\%$
test_step_mdp_speed[True-True-False-True-False] 54.0310μs 18.2457μs 54.8075 KOps/s 57.6792 KOps/s $\color{#d91a1a}-4.98\%$
test_step_mdp_speed[True-True-False-False-True] 49.0210μs 17.7724μs 56.2669 KOps/s 58.8493 KOps/s $\color{#d91a1a}-4.39\%$
test_step_mdp_speed[True-True-False-False-False] 43.1800μs 11.2226μs 89.1059 KOps/s 92.9825 KOps/s $\color{#d91a1a}-4.17\%$
test_step_mdp_speed[True-False-True-True-True] 0.1024ms 31.3327μs 31.9155 KOps/s 32.5819 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[True-False-True-True-False] 72.4640μs 20.0576μs 49.8565 KOps/s 52.6997 KOps/s $\textbf{\color{#d91a1a}-5.40\%}$
test_step_mdp_speed[True-False-True-False-True] 44.0020μs 17.7378μs 56.3767 KOps/s 58.2107 KOps/s $\color{#d91a1a}-3.15\%$
test_step_mdp_speed[True-False-True-False-False] 38.7620μs 11.1524μs 89.6667 KOps/s 93.2412 KOps/s $\color{#d91a1a}-3.83\%$
test_step_mdp_speed[True-False-False-True-True] 0.1055ms 32.8466μs 30.4446 KOps/s 31.3681 KOps/s $\color{#d91a1a}-2.94\%$
test_step_mdp_speed[True-False-False-True-False] 47.7890μs 21.3928μs 46.7447 KOps/s 48.6808 KOps/s $\color{#d91a1a}-3.98\%$
test_step_mdp_speed[True-False-False-False-True] 57.0070μs 19.2813μs 51.8637 KOps/s 52.9049 KOps/s $\color{#d91a1a}-1.97\%$
test_step_mdp_speed[True-False-False-False-False] 44.0110μs 12.7895μs 78.1890 KOps/s 82.1357 KOps/s $\color{#d91a1a}-4.81\%$
test_step_mdp_speed[False-True-True-True-True] 74.0980μs 31.2959μs 31.9531 KOps/s 32.3090 KOps/s $\color{#d91a1a}-1.10\%$
test_step_mdp_speed[False-True-True-True-False] 64.7200μs 19.8911μs 50.2738 KOps/s 52.4337 KOps/s $\color{#d91a1a}-4.12\%$
test_step_mdp_speed[False-True-True-False-True] 72.4850μs 20.2960μs 49.2707 KOps/s 49.9869 KOps/s $\color{#d91a1a}-1.43\%$
test_step_mdp_speed[False-True-True-False-False] 44.9540μs 12.5523μs 79.6665 KOps/s 82.4303 KOps/s $\color{#d91a1a}-3.35\%$
test_step_mdp_speed[False-True-False-True-True] 70.1510μs 32.9559μs 30.3436 KOps/s 30.7418 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[False-True-False-True-False] 61.2040μs 21.5092μs 46.4918 KOps/s 47.9231 KOps/s $\color{#d91a1a}-2.99\%$
test_step_mdp_speed[False-True-False-False-True] 3.2340ms 22.5936μs 44.2604 KOps/s 46.0807 KOps/s $\color{#d91a1a}-3.95\%$
test_step_mdp_speed[False-True-False-False-False] 49.3220μs 14.1207μs 70.8183 KOps/s 73.8360 KOps/s $\color{#d91a1a}-4.09\%$
test_step_mdp_speed[False-False-True-True-True] 88.3050μs 34.7609μs 28.7680 KOps/s 29.5888 KOps/s $\color{#d91a1a}-2.77\%$
test_step_mdp_speed[False-False-True-True-False] 62.1260μs 23.2071μs 43.0903 KOps/s 45.3431 KOps/s $\color{#d91a1a}-4.97\%$
test_step_mdp_speed[False-False-True-False-True] 62.4270μs 21.9242μs 45.6117 KOps/s 47.3282 KOps/s $\color{#d91a1a}-3.63\%$
test_step_mdp_speed[False-False-True-False-False] 51.7170μs 14.1426μs 70.7082 KOps/s 73.0618 KOps/s $\color{#d91a1a}-3.22\%$
test_step_mdp_speed[False-False-False-True-True] 76.3320μs 35.7088μs 28.0043 KOps/s 27.8224 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[False-False-False-True-False] 55.8440μs 24.6021μs 40.6470 KOps/s 42.2991 KOps/s $\color{#d91a1a}-3.91\%$
test_step_mdp_speed[False-False-False-False-True] 61.7750μs 23.3543μs 42.8186 KOps/s 44.2324 KOps/s $\color{#d91a1a}-3.20\%$
test_step_mdp_speed[False-False-False-False-False] 49.7430μs 15.6578μs 63.8658 KOps/s 67.5091 KOps/s $\textbf{\color{#d91a1a}-5.40\%}$
test_values[generalized_advantage_estimate-True-True] 10.1691ms 9.7774ms 102.2762 Ops/s 99.9300 Ops/s $\color{#35bf28}+2.35\%$
test_values[vec_generalized_advantage_estimate-True-True] 38.7685ms 35.6208ms 28.0735 Ops/s 27.3764 Ops/s $\color{#35bf28}+2.55\%$
test_values[td0_return_estimate-False-False] 0.2372ms 0.1689ms 5.9217 KOps/s 5.7882 KOps/s $\color{#35bf28}+2.31\%$
test_values[td1_return_estimate-False-False] 27.3423ms 23.9502ms 41.7533 Ops/s 41.1937 Ops/s $\color{#35bf28}+1.36\%$
test_values[vec_td1_return_estimate-False-False] 37.9085ms 36.0196ms 27.7626 Ops/s 27.5358 Ops/s $\color{#35bf28}+0.82\%$
test_values[td_lambda_return_estimate-True-False] 38.0192ms 34.6166ms 28.8879 Ops/s 29.1356 Ops/s $\color{#d91a1a}-0.85\%$
test_values[vec_td_lambda_return_estimate-True-False] 38.0736ms 36.2069ms 27.6190 Ops/s 27.5371 Ops/s $\color{#35bf28}+0.30\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.5530ms 8.2913ms 120.6084 Ops/s 120.3953 Ops/s $\color{#35bf28}+0.18\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 3.2068ms 2.0052ms 498.7144 Ops/s 523.1271 Ops/s $\color{#d91a1a}-4.67\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.5123ms 0.3558ms 2.8104 KOps/s 2.7733 KOps/s $\color{#35bf28}+1.34\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 47.0096ms 46.0366ms 21.7219 Ops/s 21.9101 Ops/s $\color{#d91a1a}-0.86\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 4.0597ms 3.1376ms 318.7131 Ops/s 318.7329 Ops/s $-0.01\%$
test_dqn_speed 6.6172ms 1.3189ms 758.2168 Ops/s 747.4827 Ops/s $\color{#35bf28}+1.44\%$
test_ddpg_speed 3.5778ms 2.7313ms 366.1267 Ops/s 358.1932 Ops/s $\color{#35bf28}+2.21\%$
test_sac_speed 9.3083ms 8.0499ms 124.2254 Ops/s 121.8941 Ops/s $\color{#35bf28}+1.91\%$
test_redq_speed 13.7392ms 12.9442ms 77.2549 Ops/s 74.6777 Ops/s $\color{#35bf28}+3.45\%$
test_redq_deprec_speed 17.0354ms 13.0091ms 76.8690 Ops/s 74.6035 Ops/s $\color{#35bf28}+3.04\%$
test_td3_speed 8.6639ms 8.1711ms 122.3824 Ops/s 121.4399 Ops/s $\color{#35bf28}+0.78\%$
test_cql_speed 36.8269ms 35.4878ms 28.1787 Ops/s 27.7222 Ops/s $\color{#35bf28}+1.65\%$
test_a2c_speed 8.1632ms 7.3738ms 135.6160 Ops/s 133.0164 Ops/s $\color{#35bf28}+1.95\%$
test_ppo_speed 9.0342ms 7.6439ms 130.8224 Ops/s 129.7388 Ops/s $\color{#35bf28}+0.84\%$
test_reinforce_speed 7.6602ms 6.6015ms 151.4804 Ops/s 147.8976 Ops/s $\color{#35bf28}+2.42\%$
test_iql_speed 33.6330ms 32.0841ms 31.1681 Ops/s 30.9239 Ops/s $\color{#35bf28}+0.79\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.6154ms 4.9462ms 202.1746 Ops/s 201.4218 Ops/s $\color{#35bf28}+0.37\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9489ms 0.4740ms 2.1095 KOps/s 2.0636 KOps/s $\color{#35bf28}+2.23\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 1.2365ms 0.4731ms 2.1137 KOps/s 2.1940 KOps/s $\color{#d91a1a}-3.66\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.4281ms 5.0042ms 199.8316 Ops/s 203.6170 Ops/s $\color{#d91a1a}-1.86\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9440ms 0.4671ms 2.1411 KOps/s 2.1089 KOps/s $\color{#35bf28}+1.52\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.8182ms 0.4438ms 2.2532 KOps/s 2.2196 KOps/s $\color{#35bf28}+1.51\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 2.7093ms 1.6932ms 590.6147 Ops/s 592.0832 Ops/s $\color{#d91a1a}-0.25\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.8649ms 1.5960ms 626.5581 Ops/s 625.5169 Ops/s $\color{#35bf28}+0.17\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.7869ms 5.0540ms 197.8640 Ops/s 196.4219 Ops/s $\color{#35bf28}+0.73\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.1588s 0.7522ms 1.3294 KOps/s 1.6340 KOps/s $\textbf{\color{#d91a1a}-18.64\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 1.0016ms 0.5793ms 1.7262 KOps/s 1.7124 KOps/s $\color{#35bf28}+0.81\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.5284ms 4.9178ms 203.3432 Ops/s 201.1345 Ops/s $\color{#35bf28}+1.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6095ms 0.4911ms 2.0362 KOps/s 1.5401 KOps/s $\textbf{\color{#35bf28}+32.21\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.9976ms 0.4587ms 2.1800 KOps/s 2.1806 KOps/s $\color{#d91a1a}-0.03\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.7187ms 5.1378ms 194.6363 Ops/s 200.7079 Ops/s $\color{#d91a1a}-3.03\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.9418ms 0.4900ms 2.0408 KOps/s 2.1281 KOps/s $\color{#d91a1a}-4.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.8454ms 0.4615ms 2.1670 KOps/s 2.1763 KOps/s $\color{#d91a1a}-0.43\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 5.6787ms 5.3994ms 185.2062 Ops/s 196.8342 Ops/s $\textbf{\color{#d91a1a}-5.91\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4360ms 0.6167ms 1.6216 KOps/s 1.6218 KOps/s $\color{#d91a1a}-0.01\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8132ms 0.5911ms 1.6917 KOps/s 1.7127 KOps/s $\color{#d91a1a}-1.23\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1754s 7.4429ms 134.3569 Ops/s 145.5357 Ops/s $\textbf{\color{#d91a1a}-7.68\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 17.8436ms 13.4062ms 74.5924 Ops/s 77.2007 Ops/s $\color{#d91a1a}-3.38\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.8275ms 1.2105ms 826.1276 Ops/s 763.5742 Ops/s $\textbf{\color{#35bf28}+8.19\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1266s 8.8072ms 113.5431 Ops/s 154.7178 Ops/s $\textbf{\color{#d91a1a}-26.61\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 17.5322ms 13.2097ms 75.7020 Ops/s 77.0364 Ops/s $\color{#d91a1a}-1.73\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.7638ms 1.2181ms 820.9837 Ops/s 770.7136 Ops/s $\textbf{\color{#35bf28}+6.52\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1258s 6.5526ms 152.6116 Ops/s 106.0166 Ops/s $\textbf{\color{#35bf28}+43.95\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 17.5106ms 13.2618ms 75.4043 Ops/s 76.6280 Ops/s $\color{#d91a1a}-1.60\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 5.9870ms 1.4773ms 676.9289 Ops/s 702.4889 Ops/s $\color{#d91a1a}-3.64\%$

@github-actions GitHub Actions
Copy link

github-actions bot commented Sep 4, 2024

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 94. Improved: $\large\color{#35bf28}9$. Worsened: $\large\color{#d91a1a}10$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_single 0.1069s 0.1043s 9.5842 Ops/s 9.4813 Ops/s $\color{#35bf28}+1.09\%$
test_sync 0.1008s 93.4589ms 10.6999 Ops/s 10.6718 Ops/s $\color{#35bf28}+0.26\%$
test_async 0.2588s 86.1309ms 11.6102 Ops/s 11.3875 Ops/s $\color{#35bf28}+1.96\%$
test_single_pixels 0.1107s 0.1098s 9.1060 Ops/s 9.0847 Ops/s $\color{#35bf28}+0.23\%$
test_sync_pixels 82.9097ms 72.6041ms 13.7733 Ops/s 13.9609 Ops/s $\color{#d91a1a}-1.34\%$
test_async_pixels 0.2148s 67.7544ms 14.7592 Ops/s 14.9808 Ops/s $\color{#d91a1a}-1.48\%$
test_simple 0.7610s 0.7573s 1.3205 Ops/s 1.2957 Ops/s $\color{#35bf28}+1.91\%$
test_transformed 0.9940s 0.9898s 1.0103 Ops/s 0.9909 Ops/s $\color{#35bf28}+1.96\%$
test_serial 2.2230s 2.1620s 0.4625 Ops/s 0.4573 Ops/s $\color{#35bf28}+1.14\%$
test_parallel 1.9532s 1.8888s 0.5294 Ops/s 0.5276 Ops/s $\color{#35bf28}+0.35\%$
test_step_mdp_speed[True-True-True-True-True] 0.2009ms 37.6520μs 26.5590 KOps/s 26.8158 KOps/s $\color{#d91a1a}-0.96\%$
test_step_mdp_speed[True-True-True-True-False] 55.4310μs 21.9629μs 45.5313 KOps/s 46.6883 KOps/s $\color{#d91a1a}-2.48\%$
test_step_mdp_speed[True-True-True-False-True] 56.1610μs 21.9121μs 45.6368 KOps/s 47.2268 KOps/s $\color{#d91a1a}-3.37\%$
test_step_mdp_speed[True-True-True-False-False] 38.9810μs 12.2638μs 81.5406 KOps/s 81.3251 KOps/s $\color{#35bf28}+0.27\%$
test_step_mdp_speed[True-True-False-True-True] 77.9610μs 40.5254μs 24.6759 KOps/s 25.8718 KOps/s $\color{#d91a1a}-4.62\%$
test_step_mdp_speed[True-True-False-True-False] 58.9410μs 24.0428μs 41.5925 KOps/s 42.5449 KOps/s $\color{#d91a1a}-2.24\%$
test_step_mdp_speed[True-True-False-False-True] 55.7510μs 24.0894μs 41.5120 KOps/s 42.9961 KOps/s $\color{#d91a1a}-3.45\%$
test_step_mdp_speed[True-True-False-False-False] 42.2110μs 15.1197μs 66.1389 KOps/s 70.2065 KOps/s $\textbf{\color{#d91a1a}-5.79\%}$
test_step_mdp_speed[True-False-True-True-True] 81.4320μs 42.8114μs 23.3582 KOps/s 23.8327 KOps/s $\color{#d91a1a}-1.99\%$
test_step_mdp_speed[True-False-True-True-False] 57.0110μs 26.0278μs 38.4205 KOps/s 39.2525 KOps/s $\color{#d91a1a}-2.12\%$
test_step_mdp_speed[True-False-True-False-True] 55.4010μs 23.3469μs 42.8323 KOps/s 43.5026 KOps/s $\color{#d91a1a}-1.54\%$
test_step_mdp_speed[True-False-True-False-False] 43.5110μs 14.8810μs 67.1999 KOps/s 69.1551 KOps/s $\color{#d91a1a}-2.83\%$
test_step_mdp_speed[True-False-False-True-True] 80.8220μs 44.1206μs 22.6651 KOps/s 22.7330 KOps/s $\color{#d91a1a}-0.30\%$
test_step_mdp_speed[True-False-False-True-False] 55.9110μs 28.0077μs 35.7045 KOps/s 36.0442 KOps/s $\color{#d91a1a}-0.94\%$
test_step_mdp_speed[True-False-False-False-True] 61.9610μs 25.6070μs 39.0518 KOps/s 39.3495 KOps/s $\color{#d91a1a}-0.76\%$
test_step_mdp_speed[True-False-False-False-False] 47.2610μs 16.6480μs 60.0673 KOps/s 61.0679 KOps/s $\color{#d91a1a}-1.64\%$
test_step_mdp_speed[False-True-True-True-True] 78.0210μs 42.8216μs 23.3527 KOps/s 23.4112 KOps/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[False-True-True-True-False] 56.2510μs 25.9689μs 38.5076 KOps/s 38.5447 KOps/s $\color{#d91a1a}-0.10\%$
test_step_mdp_speed[False-True-True-False-True] 68.2110μs 27.5625μs 36.2811 KOps/s 36.8632 KOps/s $\color{#d91a1a}-1.58\%$
test_step_mdp_speed[False-True-True-False-False] 51.0810μs 16.3207μs 61.2718 KOps/s 62.8107 KOps/s $\color{#d91a1a}-2.45\%$
test_step_mdp_speed[False-True-False-True-True] 77.0810μs 44.0502μs 22.7014 KOps/s 22.7564 KOps/s $\color{#d91a1a}-0.24\%$
test_step_mdp_speed[False-True-False-True-False] 59.3210μs 27.9259μs 35.8090 KOps/s 35.7262 KOps/s $\color{#35bf28}+0.23\%$
test_step_mdp_speed[False-True-False-False-True] 3.5068ms 29.5680μs 33.8204 KOps/s 34.4225 KOps/s $\color{#d91a1a}-1.75\%$
test_step_mdp_speed[False-True-False-False-False] 46.9910μs 18.5795μs 53.8227 KOps/s 55.7813 KOps/s $\color{#d91a1a}-3.51\%$
test_step_mdp_speed[False-False-True-True-True] 97.5920μs 45.7861μs 21.8407 KOps/s 21.8562 KOps/s $\color{#d91a1a}-0.07\%$
test_step_mdp_speed[False-False-True-True-False] 60.9110μs 29.7715μs 33.5892 KOps/s 33.3894 KOps/s $\color{#35bf28}+0.60\%$
test_step_mdp_speed[False-False-True-False-True] 75.2310μs 29.6357μs 33.7431 KOps/s 34.7373 KOps/s $\color{#d91a1a}-2.86\%$
test_step_mdp_speed[False-False-True-False-False] 49.5910μs 18.4631μs 54.1620 KOps/s 55.5970 KOps/s $\color{#d91a1a}-2.58\%$
test_step_mdp_speed[False-False-False-True-True] 88.4020μs 47.6493μs 20.9867 KOps/s 20.9781 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[False-False-False-True-False] 65.6910μs 32.0836μs 31.1686 KOps/s 31.1686 KOps/s $-0.00\%$
test_step_mdp_speed[False-False-False-False-True] 65.9410μs 30.4054μs 32.8889 KOps/s 32.9497 KOps/s $\color{#d91a1a}-0.18\%$
test_step_mdp_speed[False-False-False-False-False] 57.0310μs 19.9065μs 50.2347 KOps/s 49.7556 KOps/s $\color{#35bf28}+0.96\%$
test_values[generalized_advantage_estimate-True-True] 25.7112ms 25.2165ms 39.6565 Ops/s 39.0887 Ops/s $\color{#35bf28}+1.45\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1121s 3.1420ms 318.2696 Ops/s 332.2984 Ops/s $\color{#d91a1a}-4.22\%$
test_values[td0_return_estimate-False-False] 95.5710μs 68.5644μs 14.5848 KOps/s 14.2777 KOps/s $\color{#35bf28}+2.15\%$
test_values[td1_return_estimate-False-False] 57.6751ms 57.2914ms 17.4546 Ops/s 17.2357 Ops/s $\color{#35bf28}+1.27\%$
test_values[vec_td1_return_estimate-False-False] 1.4342ms 1.0879ms 919.1853 Ops/s 916.7162 Ops/s $\color{#35bf28}+0.27\%$
test_values[td_lambda_return_estimate-True-False] 94.3379ms 90.4991ms 11.0498 Ops/s 10.8820 Ops/s $\color{#35bf28}+1.54\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.4168ms 1.0843ms 922.2247 Ops/s 920.2823 Ops/s $\color{#35bf28}+0.21\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 25.2397ms 25.1214ms 39.8066 Ops/s 39.2977 Ops/s $\color{#35bf28}+1.30\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0111ms 0.7355ms 1.3597 KOps/s 1.3490 KOps/s $\color{#35bf28}+0.79\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.7876ms 0.6724ms 1.4872 KOps/s 1.4778 KOps/s $\color{#35bf28}+0.64\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.7758ms 1.5003ms 666.5345 Ops/s 675.8662 Ops/s $\color{#d91a1a}-1.38\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7736ms 0.7164ms 1.3959 KOps/s 1.4451 KOps/s $\color{#d91a1a}-3.40\%$
test_dqn_speed 7.0417ms 1.3634ms 733.4396 Ops/s 750.4998 Ops/s $\color{#d91a1a}-2.27\%$
test_ddpg_speed 3.0235ms 2.6924ms 371.4108 Ops/s 372.0599 Ops/s $\color{#d91a1a}-0.17\%$
test_sac_speed 8.2737ms 7.8040ms 128.1387 Ops/s 128.6306 Ops/s $\color{#d91a1a}-0.38\%$
test_redq_speed 0.1077s 11.0571ms 90.4396 Ops/s 98.7362 Ops/s $\textbf{\color{#d91a1a}-8.40\%}$
test_redq_deprec_speed 11.1623ms 10.5903ms 94.4260 Ops/s 93.4906 Ops/s $\color{#35bf28}+1.00\%$
test_td3_speed 8.0684ms 7.9268ms 126.1543 Ops/s 128.2855 Ops/s $\color{#d91a1a}-1.66\%$
test_cql_speed 28.5855ms 25.0297ms 39.9525 Ops/s 39.6600 Ops/s $\color{#35bf28}+0.74\%$
test_a2c_speed 5.8058ms 5.4080ms 184.9115 Ops/s 181.1915 Ops/s $\color{#35bf28}+2.05\%$
test_ppo_speed 6.2372ms 5.7698ms 173.3172 Ops/s 168.7824 Ops/s $\color{#35bf28}+2.69\%$
test_reinforce_speed 4.7831ms 4.5084ms 221.8062 Ops/s 221.2793 Ops/s $\color{#35bf28}+0.24\%$
test_iql_speed 19.8699ms 19.0416ms 52.5165 Ops/s 52.3533 Ops/s $\color{#35bf28}+0.31\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.5467ms 6.4471ms 155.1080 Ops/s 157.0119 Ops/s $\color{#d91a1a}-1.21\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.2838ms 0.3076ms 3.2508 KOps/s 4.2019 KOps/s $\textbf{\color{#d91a1a}-22.63\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6252ms 0.2893ms 3.4564 KOps/s 4.6223 KOps/s $\textbf{\color{#d91a1a}-25.22\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.6249ms 6.3794ms 156.7553 Ops/s 158.3113 Ops/s $\color{#d91a1a}-0.98\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7121ms 0.3001ms 3.3327 KOps/s 4.2023 KOps/s $\textbf{\color{#d91a1a}-20.69\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4405ms 0.2848ms 3.5107 KOps/s 4.6225 KOps/s $\textbf{\color{#d91a1a}-24.05\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7238ms 1.4435ms 692.7434 Ops/s 726.3064 Ops/s $\color{#d91a1a}-4.62\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6506ms 1.3581ms 736.3151 Ops/s 780.3934 Ops/s $\textbf{\color{#d91a1a}-5.65\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.6729ms 6.5573ms 152.5013 Ops/s 153.0529 Ops/s $\color{#d91a1a}-0.36\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8211ms 0.4283ms 2.3348 KOps/s 2.0873 KOps/s $\textbf{\color{#35bf28}+11.86\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.5149ms 0.3619ms 2.7632 KOps/s 2.1771 KOps/s $\textbf{\color{#35bf28}+26.92\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.6267ms 6.3892ms 156.5148 Ops/s 157.8149 Ops/s $\color{#d91a1a}-0.82\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6086ms 0.2417ms 4.1370 KOps/s 2.8807 KOps/s $\textbf{\color{#35bf28}+43.61\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.3797ms 0.2180ms 4.5863 KOps/s 3.0664 KOps/s $\textbf{\color{#35bf28}+49.57\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.6789ms 6.3857ms 156.6006 Ops/s 158.0440 Ops/s $\color{#d91a1a}-0.91\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.7885ms 0.2396ms 4.1735 KOps/s 2.9391 KOps/s $\textbf{\color{#35bf28}+42.00\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6570ms 0.2182ms 4.5829 KOps/s 3.1378 KOps/s $\textbf{\color{#35bf28}+46.05\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.8403ms 6.5673ms 152.2699 Ops/s 154.3784 Ops/s $\color{#d91a1a}-1.37\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.6773ms 0.3923ms 2.5488 KOps/s 2.0666 KOps/s $\textbf{\color{#35bf28}+23.34\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7686ms 0.3623ms 2.7599 KOps/s 2.1922 KOps/s $\textbf{\color{#35bf28}+25.90\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.1540s 8.1602ms 122.5461 Ops/s 94.5971 Ops/s $\textbf{\color{#35bf28}+29.55\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 21.5944ms 16.2806ms 61.4229 Ops/s 61.4117 Ops/s $\color{#35bf28}+0.02\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1660ms 0.9887ms 1.0114 KOps/s 999.3646 Ops/s $\color{#35bf28}+1.21\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.1315s 7.7377ms 129.2372 Ops/s 129.2793 Ops/s $\color{#d91a1a}-0.03\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 21.3138ms 16.1395ms 61.9599 Ops/s 61.4423 Ops/s $\color{#35bf28}+0.84\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 9.0406ms 1.1527ms 867.5496 Ops/s 999.7523 Ops/s $\textbf{\color{#d91a1a}-13.22\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.1356s 7.9914ms 125.1351 Ops/s 127.7685 Ops/s $\color{#d91a1a}-2.06\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 0.1424s 18.8770ms 52.9746 Ops/s 61.2722 Ops/s $\textbf{\color{#d91a1a}-13.54\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 8.0749ms 1.2746ms 784.5623 Ops/s 860.1045 Ops/s $\textbf{\color{#d91a1a}-8.78\%}$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@vmoens @facebook-github-bot